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This listing of claims will replace all prior versions, and listings, of claims in the application: 
Listing of Claims: 

Claim 1 (currently amended): A method of organizing media objects in a database, comprising: 
capturing a media object; 

detecting attributes of the captured m edia object indicated in metadata for the captured 
media object; 

identifying media objects stored in the database that are related to the captured media 

object; 

inferring organization information for the captured m edia object based upon information 
obtained from each of the stored media objects that are related to the captured m edia object; and 

organizing the captured media object in the database based upon the inf e r e nc einferred 
organization information, 

wherein the step of inferring includes a step of determining whether data associated with 
the captured media object exceeds a threshold, 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 

Claim 2 (currently amended): The method according to claim 1, wherein the detecting step 
comprises: 

detecting attributes of the captured media object generated when the media object was 
captured. 

Claim 3 (currently amended): The method according to claim 1, wherein the organizing step 
includes storing the captured m edia object in the database, and wherein the method further 
comprises assigning at least one attribute to the metadata for the captured media object prior to 
storing the captured m edia object. 

Claim 4 (currently amended): The method according to claim 1, further comprising: 
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assigning at least one attribute to the metadata for the captured m edia object based upon 
the inferonc o inferred organization information . 

Claim 5 (currently amended): The method according to claim 1, further comprising: 
detecting common features of the stored media objects; 
identifying the stored media objects that have common features; and 
eliminating the stored media objects that are not identified prior to inferring the 

organizing o rganization information. 

Claim 6 (currently amended): The method according to claim 5, further comprising: 

adding information to the attributes of the metadata of the captured media object based 
upon the common features of the stored media objects. 

Claim 7 (currently amended): The method according to claim 6, further comprising: 

adding information to the metadata of the captured media object indicating that the 
inferred o rganization information for the captured media object was determined based upon an 
inference. 

Claim 8 (currently amended): The method according to claim 1, further comprising: 

adding information to the metadata of the captured m edia object indicating that the 
inferred organization information for the captured media object was determined based upon an 
inference. 

Claim 9 (currently amended): A method of organizing media objects in a database, comprising: 
capturing a media object; 

determining attributes of the captured media object indicated in metadata for the captured 
media object; 

determining a date on which the captured media object was captured, wherein the date 
comprises one of the attributes of the captured m edia object; 
comparing the date with threshold date information; 
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identifying media objects stored in the database that are related to the captured media 
object based upon the comparison; 

inferring organization information for the captured m edia object based upon information 
obtained from each of the stored media objects related to the captured media object-iand 

organizing the captured m edia object in the database based upon the infer e nc o inferred 
organization information, 

wherein the step of inferring includes a step of determining whether the date is within the 
threshold date information, 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 

Claim 10 (currently amended): A method of organizing media objects in a database, comprising: 
capturing a media object; 

determining attributes of the captured m edia object indicated in metadata for the captured 
media object; 

determining a date on which the captured m edia object was captured, wherein the date 
comprises one of the attributes of the captured m edia object; 

comparing the date on which the captured m edia object was captured with entries in a 
date book; 

inferring organization information for the captured m edia object based upon the 
comparison; and 

organizing the captured m edia object in the database based upon the infer e nc o inferred 
organization information, 

wherein the step of inferring includes a step of determining whether the date on which the 
captured media object was captured is within a threshold range, 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 



Claim 11 (currently amended): 
comprises: 
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comparing the date on which the captured m edia object was captured with entries in a 
global date book. 

Claim 12 (currently amended): A method of organizing media objects in a database, comprising: 
capturing a media object; 

detecting attributes of the captured m edia object indicated in metadata for the captured 
media object; 

performing an inexact search of the database based upon at least one of the attributes of 
the captured media object to identify media objects stored in the database that are related to the 
captured m edia object; 

inferring organization information for the captured m edia object based upon information 
obtained from each of the stored media objects that are related to the captured m edia object; and 

organizing the captured m edia object in the database based upon the inf e r e nc einferred 
organization information, 

wherein the step of inferring includes a step of determining whether data associated with 
the captured media object exceeds a threshold, 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 

Claim 13 (currently amended): The method according to claim 12, wherein the inexact search 
step comprises: 

performing an inexact search of the database based upon a date on which the captured 
media object was captured, wherein the date comprises one of the attributes of the captured 
media object. 

Claim 14 (currently amended): The method according to claim 12, wherein the inexact search 
step comprises: 

performing an inexact search of the database based upon a location where the captured 
media object was captured, wherein the location comprises one of the attributes of the captured 
media object. 
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Claim 1 5 (currently amended): A method of organizing media objects in a database, comprising: 
capturing a media object; 

comparing the captured media object with media objects that are stored in the database; 

identifying the stored media objects in the database that include features in common with 
the captured media object; 

inferring organization information for the captured media object based upon information, 
obtained from each of the media objects including features in common with the captured media 
object, representing organization in the database; and 

organizing the captured media object in the database based upon the inf e r e nc einferred 
organization information, 

wherein the step of inferring includes a step of determining whether data associated with 
the captured media object exceeds a threshold. 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 

Claim 16 (currently amended): A method of organizing media objects in a database, comprising: 
capturing a media object; 

identifying a feature of the captured m edia object; 

comparing the feature of the captured m edia object with stored media objects that are 
stored in the database; 

identifying the stored media objects having the identified feature; 

inferring organization information for the captured m edia object based upon information 
obtained from each of the stored media objects having the identified feature of the captured 
media object; and 

organizing the captured m edia object in the database based upon the inforonc o inferred 
organization information. 

wherein the step of inferring includes a step of determining whether the identified feature 
of the captured media object exceeds a threshold, 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 

Page 6 of 19 



Appln.Na: 10/021,255 

Amendment dated May 26, 2005 

Reply to Office Action of January 14, 2005 

Claim 17 (currently amended): A method of organizing media objects in a database, comprising: 
capturing a media object; 

identifying a feature of the captured m edia object; 

performing an inexact search to detect stored media objects that are stored in the database 
having the identified feature of the captured media object; 

identifying the stored media objects having the identified feature of the captured m edia 

object; 

inferring organization information for the captured media object based upon information 
obtained from each of the stored media objects having the feature identified in the captured 
media object; and 

organizing the captured m edia object in the database based upon the inf e r e nc einferred 
organization information, 

wherein the step of inferring includes a step of determining whether the identified feature 
of the captured media object exceeds a threshold. 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 

Claim 18 (currently amended): A computer-readable medium having computer-executable 
instructions for performing the steps of: 
capturing a media object; 

detecting attributes of the captured m edia object indicated in metadata for the captured 
media object; 

identifying media objects stored in the database that are related to the captured media 

object; 

inferring organization information for the captured m edia object based upon information 
obtained from each of the stored media objects that are related to the captured m edia object; and 

organizing the captured media object in the database based upon the inferonc o inferred 
organization information, 

wherein the step of inferring includes a step of determining whether data associated with 
the captured media object exceeds a threshold. 
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wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 

Claim 19 (currently amended): The computer-readable medium according to claim 18, wherein 
the detecting step comprises: 

detecting attributes of the captured m edia object generated when the captured media 
object was captured. 

Claim 20 (currently amended): The computer-readable medium according to claim 18, wherein 
the organizing step includes storing the captured media object in the database, the computer- 
readable medium having further computer-executable instructions for performing the step of 
assigning at least one attribute to the metadata for the captured m edia object prior to storing the 
captured media object. 

Claim 21 (currently amended): The computer-readable medium according to claim 18, having 
further computer-executable instructions for performing the step of: 

assigning at least one attribute to the metadata for the captured m edia object based upon 
the inf e r e nc einferred organization information . 

Claim 22 (original): The computer-readable medium according to claim 18, having further 

computer-executable instructions for performing the steps of: 
detecting common features of the stored media objects; 
identifying the stored media objects that have common features; and 
eliminating the stored media objects that are not identified prior to inferring the 

organizing information. 

Claim 23 (currently amended): The computer-readable medium according to claim 22, having 
further computer-executable instructions for performing the step of: 

adding information to the attributes of the metadata of the captured media object based 
upon the common features of the stored media objects. 
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Claim 24 (currently amended): The computer-readable medium according to claim 23, having 
further computer-executable instructions for performing the step of: 

adding information to the metadata of the captured media object indicating that the 
inferred organization information for the captured m edia object was determined based upon an 
inference. 

Claim 25 (currently amended): The computer-readable medium according to claim 18, having 
further computer-executable instructions for performing the step of: 

adding information to the metadata of the captured media object indicating that the 
inferred organization information for the captured media object was determined based upon an 
inference. 

Claim 26 (currently amended): A computer-readable medium having computer-executable 
instructions for performing the steps of: 
capturing a media object; 

determining attributes of the captured media object indicated in metadata for the captured 
media object; 

determining a date on which the captured m edia object was captured, wherein the date 
comprises one of the attributes of the captured m edia object; 
comparing the date with threshold date information; 

identifying stored media objects stored in the database that are related to the captured 
media object based upon the comparison; 

inferring organization information for the captured m edia object based upon information 
obtained from each of the stored media objects related to the captured m edia object; and 

organizing the captured media object in the database based upon the inforonc o inferred 
organization information, 

wherein the step of inferring includes a step of determining whether the date is within the 
threshold date information. 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 
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Claim 27 (currently amended): A computer-readable medium having computer-executable 
instructions for performing the steps of: 
capturing a media object; 

determining attributes of the captured m edia object indicated in metadata for the ca ptured 
media object; 

determining a date on which the captured m edia object was captured, wherein the date 
comprises one of the attributes of the captured m edia object; 

comparing the date on which the captured media object was captured with entries in a 
date book; 

inferring organization information for the captured m edia object based upon the 
comparison; and 

organizing the captured m edia object in the database based upon the inferonc o inferred 
organization information, 

wherein the step of inferring includes a step of determining whether the date on which the 
captured media object was captured is within a threshold range. 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 

Claim 28 (currently amended): The computer-readable medium according to claim 27, wherein 
the comparing step comprises: 

comparing the date on which the captured media object was captured with entries in a 
global date book. 

Claim 29 (currently amended): A computer-readable medium having computer-executable 
instructions for performing the steps of: 
capturing a media object; 

detecting attributes of the captured m edia object indicated in metadata for the captured 
media object; 
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performing an inexact search of the database based upon at least one of the attributes of 
the captured m edia object to identify stored media objects stored in the database that are related 
to the captured m edia object; 

inferring organization information for the captured media object based upon information 
obtained from each of the stored media objects that are related to the captured media object; and 

organizing the captured media object in the database based upon the inf e r e nc einferred 
organization information, 

wherein the step of inferring includes a step of determining whether data associated with 
the captured media object exceeds a threshold. 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 

Claim 30 (currently amended): The computer-readable medium according to claim 29, wherein 
the inexact search step comprises: 

performing an inexact search of the database based upon a date on which the captured 
media object was captured, wherein the date comprises one of the attributes of the captured 
media object. 

Claim 31 (currently amended): The computer-readable medium according to claim 29, wherein 
the inexact search step comprises: 

performing an inexact search of the database based upon a location where the captured 
media object was captured, wherein the location comprises one of the attributes of the captured 
media object. 

Claim 32 (currently amended): A computer-readable medium having computer-executable 
instructions for performing the steps of: 
capturing a media object; 

comparing the captured m edia object with stored media objects that are stored in the 
database; 



Page 11 of 19 



Appln.No.: 10/021,255 

Amendment dated May 26, 2005 

Reply to Office Action of January 14, 2005 

identifying the stored media objects in the database that include features in common with 
the captured m edia object; 

inferring organization information for the captured m edia object based upon information 
obtained from each of the media objects including features in common with the captured media 
object; and 

organizing the captured media object in the database based upon the inf e r e nc einferred 
organization information, 

wherein the step of inferring includes a step of determining whether data associated with 
the captured media object exceeds a threshold, 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 

Claim 33 (currently amended): A computer-readable medium having computer-executable 
instructions for performing the steps of: 
capturing a media object; 

identifying a feature of the captured media object; 

comparing the feature of the captured media object with stored media objects that are 
stored in the database; 

identifying the stored media objects having the identified feature of the captured media 

object; 

inferring organization information for the captured m edia object based upon information 
obtained from each of the stored media objects having the identified feature of the ca ptured 
media object; and 

organizing the captured m edia object in the database based upon the inf e renc o inferred 
organization information, 

wherein the step of inferring includes a step of determining whether the identified feature 
of the captured media object exceeds a threshold, 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 
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Claim 34 (currently amended): A computer-readable medium having computer-executable 
instructions for performing the steps of: 
capturing a media object; 

identifying a feature of the captured media object; 

performing an inexact search to detect stored media objects that are stored in the database 
having the identified feature of the captured m edia object; 

identifying the stored media objects having the identified feature of the captured media 

object; 

inferring organization information for the captured m edia object based upon information 
obtained from each of the stored media objects having the id e ntifi e d feature ef -identified in the 
captured media object; and 

organizing the captured m edia object in the database based upon the inf e r e nc e inferred 
organization information, 

wherein the step of inferring includes a step of determining whether the identified feature 
of the captured media object exceeds a threshold. 

wherein the step of inferring includes a step of determining into which group of stored 
media objects to store the captured media object . 

Claim 35 (currently amended): A method of organizing media objects in a database, comprising: 
detecting a capture time for each of the media objects to be organized; 
sorting the media objects based upon the capture time to generate a sorted list; 
comparing the capture time of each of the media objects with a reference value; and 
grouping storing the media objects in the database based upon the comparison. 

Claim 36 (currently amended): The method according to claim 35, wherein the comparing step 
comprises: 

determining whether the capture time of the each of the media objects is within a 
predetermined time period from the reference value; and 



Page 13 of 19 



Appln.No.: 10/021,255 

Amendment dated May 26, 2005 

Reply to Office Action of January 14, 2005 



wherein the grouping storing step comprises grouping at least one of the media objects 
into a collection when the capture time of the at least one of the media objects is within the 
predetermined time period from the reference value. 

Claim 37 (original): The method according to claim 36, further comprising: 

selecting a representative media object from the at least one of the media objects grouped 
in the collection for use as a user interface. 

Claim 38 (currently amended): The method according to claim 37, further comprising: 

repeating the comparing step, the grouping storing step and the selecting step for each of 
the media objects in the sorted list. 

Claim 39 (currently amended): The method according to claim 35, further comprising: 
setting a-the reference value to a predetermined value; 

determining whether the capture time of a first one of the media objects in the sorted list 
is within a predetermined time period from the reference value; 

grouping the first one of the media objects into a collection when the capture time of the 
first one of the media objects is within the predetermined time period from the reference value; 

updating the reference value to the capture time of the first one of the media objects in 
the sorted list to generate an updated reference value; and 

repeating the determining step, the grouping step and the updating step for each of the 
media objects in the sorted list. 

Claim 40 (original): The method according to claim 39, further comprising: 

creating a new collection when the capture time of any one of the media objects from the 
sorted list is not within the predetermined time period from the updated reference value. 

Claim 41 (original): The method according to claim 40, further comprising: 

selecting a representative media object from the collection and from each new collection 
for use as a user interface. 
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Claims 42-46 (canceled) 

Claim 47 (new): The method according to claim 1, wherein the threshold is an adaptive 
threshold. 

Claim 48 (new): The method of claim 1, wherein the threshold is a temporal designation and the 
group of stored media objects is a collection. 

Claim 49 (new): A method of organizing media objects in a database, comprising: 
capturing a media object; 

identifying media objects stored in a database that are related to the captured media 

object; 

obtaining information from each of the stored media objects that are related to the 
captured media object; 

determining where the captured media object is to be stored with respect to the stored 
media objects that are related to the captured media object based upon the obtained information; 
and 

storing the captured media object in the database. 
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